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An  inequality  for  members  of  a  Sobolev  space  of  order  one  is  demonstrated 
and  as  a  corollary  an  upper  bound,  in  tens  of  the  Fisher  information, 
is  derived  for  a  density  function^  Also  two  characterizations  of  the 
Laplace  and  the  exponential  distribution  are  indicated. 
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»  Introduction.  Let  !|*||»»  1 1  *  I  f  2  denote  the  sup^  end  L2(IR) 
norms  respectively,  and  let  g'  denote  the  first  distributional  deri¬ 
vative  of  the  function  g  in  I^CR)  .  We  will  demonstrate  inequalities 

► 

(1.1)  II*  «*ii!/  iii'ii!  <  iitii*  <  n«n2  iifii2, 

and  a  generalisation  thereof  (see  (2.3)),  for  members  g  of  a  Sobolev 
space  of  order  one.  Since  1  |g|  J2  ,  |  |g*  1 12  <  ♦  •  imply  |  |gg’  1 12  <  ♦  •  , 
through  the  relations  | fgs* 1 1|  4  ||g|| 2  t Is*  1 S  l|g|l2  I U* 1 1|  , 
tiie  lower  bound  on  ||g||M  in  (1.1)  is  immediate  we  need  derive  only 
the  upper  bound.  An  interesting  special  case  of  inequalities  (1.1), 
when  f  ■  g2  is  a  probability  density  function  on  the  real  line  with 
finite  Fisher  information.  1(f)  ■  /  f,2/f  ,  is 

tt-2)  ||f*||*/I(f)  <  | |f II.  S  I(f)%/2  , 

with  equality  in  the  rightmost  hand  side  if  and  only  if  f  is  the  density 
or  the  Laplace  distribution.  A  generalization  of  (1.2)  is  given  by 

(3.1)  below. 

It  should  be  noted  that  a  weaker  form  of  the  upper  bound  in  (1.1) 
appears  in  Tapia  and  Thompson  (1978),  page  116,  for  absolutely  contin¬ 
uous  functions.  Their  proof  can  be  modified  to  achieve  the  upper 
bound  in  (1.1),  but  our  proof  allows  slightly  more  general  functions. 

2.  An  inequality  for  members  of  a  Sobolev  space.  Let  IR  denote  the 
real  line  and  let  L2  s  L,,QR)  be  the  space  of  all  Lebesque  measurable 
square  integrable  functions  g  :  ft  *  |R  .  It  is  well  known  that 
(Lj  ,  <•  ,  >2)  is  a  Hilbert  space  for  the  inner  product  <g,h>2  =  J^gh 


and  the  induced  norm  )  |g)  =  C  /R  g2)*1  .  By  a  Sobolev  space  of  order  one 

on  tR  ,  denoted  by  H  =  H*(JR)  ,  is  meant  the  space  of  all  functions 
g  s  IR  ♦R  such  that  g,g'  z  ,  where  g’  denotes  the  distributional 
derivative  of  order  one  of  g  .  Endowed  with  the  inner  product 

<t*h>a  5  ao<g,h>2  *  ai<*,»h*>2  »  *here  S  "  (VV  ¥iXh  ao*al  >  0  • 
and  the  induced  norm  ||g|!a  -  (<g,g>  )**  »  H  is  a  reproducing 

4*  m 

kernel  Hilbert  space  (RKHS) ,  i.e.  there  exists  a  unique  real  valued 
function  k(x,y)  on  IR  n  IR  ,  called  the  reproducing  kernel  (RX),  such 
that. 


ky(*)  =  k(»,y)  e  H  for  all  ytR, 

and 


<g»ky>a  -  g(y)  for  all  gtH. 

The  kernel  of  H  is  given  by 

(1.1)  ka(x,y)  «•  (4a0o1)“,s  exp  (-(ag/Oj^lx-y |}  . 

«* 

for  a  treatment  of  the  RKHS  and  Sobolev  spaces  the  reader  is  referred 
to  Aronssajn  (1950),  Parzen  (1967),  Gel' f and  and  Shilov  (1964)  and 
Tosida  (1974). 

We  next  derive  an  inequality  which  is  valid  for  all  functions  in 
Hl«R)  .  A  discrete  version  of  this  inequality  .is  now  available  also, 
due  to  Professor  J.  Re i Ison  (personal  communication) ,  namely 

for  all  sequences  (gn)^|  in  l2  . 
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For  every  get!  we  have 


(2.2)  I  If  I  if  <  llfllj  llfllj  • 

P 

\ 

Proof:  We  endow  H  with  the  collection  of  nonu  ||*||  induced  by 

m 

the  inner  products  <*«*>a  *  defined  above.  For  every  a  -  (a0,aj)  .  with 
a0*°l  >  0  »  0*#  <*,*>a)  i*  »  RKHS  with  RK  ka  given  by  (2.1). 

Using  the  Cauchy«Schwarz  inequality  we  have  for  every  u  e  H 

1*00 1  -  |<kaC*.x),S(0>a|  <  ||k0(«,x)j|a  j|g|Io  - 

•»  •  •  e»  • 

{(4a0oir,*(o0||g||2  ♦  aJIg’lfj))51  -  <(%)  (r |  |g|  |2  ♦  r"X|  |g»  | \\»h 

where  r2  »  a0/a^  ,  for  all  aQ>aj  y  ®  •  Th«  right  side  is  nininized 

by  choosing  r  •  11**112/11*112  »  Yiel<lin*  (2.2).  D 

As  a  consequence  of  the  necessary  and  sufficient  condition  for 
equality  in  the  Cauchy-Schvarz  inequality,  equality  in  (2.2)  is  seen 
to  hold  if  and  only  if  g  is  proportional  to  exp{-A|x-a|)  ,  x,a  e  R 
and  X  >  0  . 

As  a  corollary  to  Proposition  2.1  we  derive  an  analogous  result  for 
functions  defined  on  the  half-life  or  on  a  finite  interval.  Denote  by 
H'lljj  and  IMI^j  the  l2(I)-  and  supj-norns  respectively  where 
I  •  (a,b)  c  R  . 

Proposition  2.2.  Let  I  be  a  possibly  infinite  interval  (a,b)  ,  and 
let  *#£*  «  Ljd)  .  Then 

(2.3)  ||l||2fI  <  ||g||2>1  Mg'llj,!  ♦  (*(«)2  ♦  f^)2)  /  2  • 

-  3  - 


Proof:  We  first  extend  g  to  g J  on  1R  ,  which  under  our  assumptions 
is  a  aeaber  of  H1^)  ,  where 

gj(x)  =  ♦  *<?)  ♦  8Cb)g“  b(x)  ,  X  >  0  , 

with 


for  itR  end  X  >  0  . 


Then  from  Proposition  (2.1),  we  have 

11*11!,!  -  I  let!  l!  -<  11*3:11  ll^ll2  “ 

-  <111*112  ♦  X  C*(aD2  -  KCl>)2)/2]-ll|g*|li  ♦  ♦  k0>)2)/21> 

-  < 1 1*1 12  1 1*'  1 l2  ♦  <C*(«)2  ♦  *(b)2)/2)(||g||2X  ♦  i!g'||2/X) 

♦  (C*C*)2  ♦  gO)2)J2)2)h  , 
for  all  X  >  0  .  Hence, 

I |*|l!  S  ain  (||gj|l2  MgJ'l^)  *  ll*ll2  II*’  H2  *  <*W2  ♦  gC1*)2)/2  » 

since  the  ainiaua  is  achieved  for  X  •  ||g'  *  0 

Note  that  inequality  (2.3)  is  satisfied  with  equality  if  g  is 
exponential  on  the  half-line  or  constant  on  a  finite  interval  (a,b)  . 

Also,  if  say  g(a)  ■  0  ,  then  fora  (2.3)  we  have 

lUll!  s  IUIIj  II«’IIj*jO»j/2  <  IUII2  IU’IIj*  IUIll/2  . 
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which  implies 


(2.4)  Hill!  «  2||g||2  Mfllj  . 

► 

I 

For  functions  g  t  ^((O,*-))  inequality  (2,4)  can  also  be  seen  to 
hold  by  applying  inequality  (2.2)  to  g*(x)  s  *00 !(*,-)  ♦  *(2a-*)I^^aj  , 
when  I A  denotes  the  indicator  function  of  the  set  A  .  It  is  then 
clear  that,  as  a  consequence  of  the  necessary  and  sufficient  condition  for 
equality  in  the  Cauchy-Schwar z.  inequality,  equality  in  (2.4)  with 
g  c  H*((0,<m>))  holds  if  and  only  if  g  is  exponential. 

3.  An  application.  Let  f  be  a  probability  density  function  on  a  possibly 
infinite  interval  (a,b)  and  denote  by  1(f)  =  (f1  (x))2/f(x)  dx  its 

Fisher  inforaation.  Then  1(f)  ■  4|fg* ||j  j  ,  where  g  *  f^  .  As  a 
corollary  to  Proposition  (2.2)  (which  covers  Proposition  (2.1),  we 
derive  the  following  inequality  involving  Fisher  information: 

Corollary  3.1.  Let  g  ■  f*1  be  as  in  Proposition  2.2.  Then 

(3.1)  supx  e  (a#b)  f(x)  <  IKf)**  ♦  f(a)  ♦  f(b))/2  . 

Inequality  (3.1)  may  be  modified  to  allow  for  discontinuities  of 
f  within  (a,b)  . 

Renark  3.1.  It  might  be  of  interest  to  note  the  following  two 
characterizations  of  density  functions  with  minimal  Fisher  information 
for  a  given  maximum  of  the  density  function: 

(i)  For  all  f  on  11  with  supx  f(x)  -  B  ,  I(£)  >  4B2  with 

iff  f  is  the  density  of  a  Laplace  (doubly  exponential)  distribution 
(see  the  remarks  following  Proposition  (2.1)). 


Vl-tf 


(ii)  For  all  f  on  R+  With  s\xpx  f(x)  -  B  ,  1(f)  >  B2  with  - 
if  and  only  if  f  is  exponential  (see  the  remarks  following  inequality  (2.4)). 
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